Information storage capacity of incompletely connected associative memories
نویسندگان
چکیده
منابع مشابه
Information storage capacity of incompletely connected associative memories
In this paper, the memory capacity of incompletely connected associative memories is investigated. First, the capacity is derived for memories with fixed parameters. Optimization of the parameters yields a maximum capacity between 0.53 and 0.69 for hetero-association and half of it for autoassociation improving previously reported results. The maximum capacity grows with increasing connectivity...
متن کاملStorage capacity of holographic associative memories.
The storage capacity of holographic associative memories is estimated. An argument based on the available degrees of freedom shows that the number of patterns that can be stored is limited by the space-bandwidth product of the hologram divided by the number of pixels in each pattern. A statistical calculation shows that if we attempt to store associations by multiply exposing the hologram, the ...
متن کاملStorage Capacity of Kernel Associative Memories
This contribution discusses the thermodynamic phases and storage capacity of an extension of the Hopfield-Little model of associative memory via kernel functions. The analysis is presented for the case of polynomial and Gaussian kernels in a replica symmetry ansatz. As a general result we found for both kernels that the storage capacity increases considerably compared to the Hopfield-Little model.
متن کاملInformation capacity of binary weights associative memories
We study the amount of information stored in the xed points of random instances of two binary weights associative memory models: the Willshaw Model (WM) and the Inverted Neural Network (INN). For these models, we show divergences between the information capacity (IC) as deened by Abu-Mostafa and Jacques, and information calculated from the standard notion of storage capacity by Palm and Grossma...
متن کاملOn the information storage of associative matrix memories
This paper aims at providing insights onto fundamental properties of two of the earlier models of matrix memories: non-linear, or Willshaw's matrix model, and the linear matrix memory. These are traditional models of Arti cial Neural Networks (ANNs) on which little has been done in recent years on themes such as retrieval and storage properties, which are studied in this paper. Equations for pr...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Neural Networks
سال: 1998
ISSN: 0893-6080
DOI: 10.1016/s0893-6080(98)00035-5